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-This guide discusses five cbiion' Cil author. 
Misconceptions ahd their conseguences., forking .backward in each 
instalfee to show how the difficulty light, better hare been Approached 
at the onset, ,it atteipts ,to aap out essential ^ecisioir points in 
iesson developient. Th^ decision .points identified coter (1) choosing 
the best aediui for the lesson, i2) deciding on, the goal« o^ the 
lesson, .(3) , deteriining the approach the lesson will tate, (tt) 
deciding how to guesfion the student, (5) displaying the material, - 
(6) 'allowing for all student responses, (7) replying to student 
responses, (8) informing students about their progress^ an& (9) 
evaluating the lesson. (DAG) . 



♦ Beproductloii^ sai^'ptied by. BDBS art the l2€8t that can be lade 

t ' froi the original dccnaent* ♦ 



", J 



fSpend^much more, time oi} this topic. 'She has tt> cover capita 
^CL7^ fluid flow J>ef ore the semester^ is over. A number of m 
students^ hands cCre^ up and Capt. Stephens calls ^on one say^ 
ingj "Oki we only have <time for one^ more question. " 

* "J still don't understand how you can add prSbsure and 
come Out with a nega^tive pressure . " ^ . ' < 

A few h(Lnds go down^ and students nod in shared bewil^ 
derment/ * - . , - 

^Ok\ Sgt. Jensen/^' Capt. Stephens asks^ "what will h'ap- 
per} if we increase the ambient pressure in this case to...^ 

As she's talkina Sgt. Slack is glad she didn't ask him. 
He doesn't know the answer. Neither^ as it turns out does 
Sgt. JenBenj but Jensen cqmes up with an, alternative Slack 
would never have thoug^ of. Capt**: Stephens analyzes why it's 
.wrongs and in doing so clarifies the ^oint for a number of 
other studentt, ' ' 

After finishin^^er explanation^ Capt. Stephens turns 
and Beans the students ' faeces. Only^ a couple of those* who ^ 
posed the origiiyil question still look puzzled. 

"Do-es that make mt^re sense now?''^ * 

Enough stucfents SO that Cap$. * Stephens feelB the 

^clas^ is rdady to move on. Shea's awate that a number of stu- ^ 
denies are being left behind^ but th^er %opio has already taken 
more time than she had anticipated^ and the end of the semester 
S'S nedrzng ^ * ' ^ 

f "Ok^ do the 'remainder of the problems to be handed in 

ilk 
get 

started on. . . " 



the n^zt time we meet. Anyone who's stilly con f^^sed care tali 
to me lafter class. » ^ow in the time that's ^ft I want to gi 
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- • Jh a small ^ lecture vQorrk hundreds .^f miles away an ^ 
vnstructor is delivering his 26th annual lecture on the wovk^ 
ings of the fuel injectioi} systefn. Occaqionally he looks itp 
for a cursory scrutiny of the students' faces* coi^ple of 
students Q^e aBleei^ in the back^ but mcfst are' diligently 

^ ^ - ' , -4 ^ . 
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• ' - IHTRODUCTIOH . . * 

Host "hOH-te'' .guidejs start from the beginning and work 
forvard- This one .wprJ<s backward / It starts with a -number 
of comDon CAI author "myths" (misconceptions) and their '^ri:^- 
zly ponsequences, then works 'backward to how the matter might 
better have been approached in the first place. For this 
reason I this ^uide is not, so^much an attempt to •instruct as 
to forewarn. 

- Part of the probl^ with beiag. a begini\er at anything is 
the fact th^t you don'*t always know what questions ^to ask/or 
recogj^ze . the times when there are decisions' to be made.y 
Thus, oyr intention here is not' only to unearth some miicon- 
cept ions but' tb map out essejitial decision points-^tn lesson 

development. rWe. don't claim- that these are ail/the decisions-* 

* * ' — ^ 

/you will ever need to 'make , Ujt dealing at minimum with the?^ 
decisions alone Should help you* write effective lessons. We 
also don»t claim (or:- in^tend) that this will provide all the 
instruction you need for coping with these decisiofis. Our 
sfein intent is to present ways to tMnk about each of the 
topics presented. . * * ^ • 

As ^ou go through each section, bear in mind that 
although individuaT topics ^ay fall undfer only one heading, 
this is not ^ good reflection of thfe real-life development 
process. -Ho st-^opicS. spill over, into others.' On^ aspect. of 
,writi'ng,,this sort of gdlMe^ ls a persistent feefing- of always 
overlap]5ing. Starting on ^e topic, we inevitably^ fo!|gd our- 
selves saying) THell, yes but you can«t really taik about X 
without' also talking' about Y;" And on it would, go. So if you 
begin jto get t^he feelir^ .you* ve heard this ali-iej^e, you 
probably have. ''^ J ' ^ . 

One'' final, commint: as unbeli^yable as it may^seem, all 
the 'anecdotes related here are ti-u^. They come f rote- a vari*^ 
ety'of 'training and educational settings. 'As well-in ten tioj^d 
afs aytbors. -are.„ anjrone caij fgll prey %o thes? pitfalls. ' 



f MYTH: IF YOU -KNOW HOW TQ T5ACH, YOU KNOW -CAI.- ' ' 

4. 

It ia Z:ZO in the afternoon* For the last Half 'hour or 
80 the, ins.tructor and the 32 students in classroom B of, the 
Paramedical Training Centej" ha'i^ been continuing a discission 
on capillary fluid flow l^at began at their last session. 
Congregated in the farthest fe\^ a^ats of the first- ar}d' second 
vows are "the brains" of the d^ass. ^hey understand capil^ , 
lary fluid dynamics p&rfectly. Indeed^ they unSterstood it 
perfectly wherf^hey *came to- class. As^ the discussion we^ars 
on^ they become increasingly *bored and irritate4 dt the - '" 
thought that they have to sit through ^eem,ingVy interminable 
revetitions of the same points* They stouch in their' 8 eats 
doodling in theii* notebooks or , starting daydr^eqmily out the 
windows^ ' * * J. ' ' 

In tbe^ back of* the Yoom <zre the slowest students. ,piey 
are so' thoroughly confused they donH even know what ques^ 
tions to ask. The most t^ey can manage is a disheartened^ "I 
don^t get i^t." They are acutely aware thfict they are* the ont^ 
people in the room who ^ar^nH following the dtscussivon* 
Mainly they feel "stupid" — so much so that they wonH takq 
the risk of asking whs^ they fear wot^ld be a "dumb ^/ quee^t ion. 
They slouch lin their Jkqts^ doodling in their notebooks^ or 
staring die^couragedty out the^windqws. 

Most of the studerfts have -been bond^n^raifing and ^follow- . 
ing tTie spirit if not the^ letter of the discuaeion* ^ Their . 
comprehension ebbs and* flows throughout the .se&sion .like a' 
musi)^ box running 'down and being rewound again. Each feels 
s/he understands certain elements^ but how the compj>n^7!t8 fif 
together into a whole is stitZ a littte murky in mo^ of 
their minds* Capt. Stephens^ the instructavy is going over 
a problem on the board fori the third time. $he^ racking \ . 
her mind to think of ye^ another way to reatatd^the sarne con^ 
cept. She aVBo knohysl however^ that ahe can^^l^ afford to^ * ^ 
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^8pendtmuoh more, time orj this topic. 'She has tv cover capita 
^ai^ fluid flow Jbef ore the semester^ is over. A number of 
' students' hands ccre^ up and Capt. Stephens calls ^on one say- 
ing^ "Ok^ we only have <time for one- more question* " 

' "J still don't understand how you can qddprSbsure and 
come dut with a nega^tive pressure. " , . * < 

A few hfinds go down^ and students nod in shared bewil- 
*derment / " - . ^ 

^Ok^ Sgt. Jensen^^" Capt. Stephens asksj ''what will hap- 
^ver} if we increase the ambient pressure in this case to..." 

As she's talking Sgt. Slac\ is glad she didn^t ask him. 
Be doesn't know the answer. Neitherj as it turns out does 
Sgt. Jensen^ but Jensen cqmes up, wiih an, alternative Slack 
would never have thought of. Capt*: Stephens analyzes why it'^s 
.wrong/ and in doing so^ clarifies the point for a numher of 
other studenti.^ * * . • 

After finishing'^er explanation^ Capt. Stephens turns 
and scans the students^ facres. Only^ a couple of those who ^ 
posed the origirifil question still look puzzled* 

"D&es that make mbx*e sense now2^ » , ^ , ^ 

Enough stu(fents rCod ao that Cap^. * Stephens feel^ the 
is pdady to move 6n. Sha^s awai^e that a number of-stu- 
denps are being left behind^ but this' %opic has already taken 
more time than she had antidipatedj and the end of the seme&te: 
is necCring ^ ' ' * 

^\ ^ "Ok J do the 'Remainder of the proJ?lems to be handed in 
the n^xt time we meet. Anyone who's stilly con fi^sed can talk 
to me lafter class. » ^ow in the time that's "i^ft I want to get 
started on. . * ^ 



- • Jn a .small ^'lecture rQonk hundreds miles away an ^ 
• * .* * 

instructor is delivering his 26th annual lecture on the work^ 
• • # ■ ^ 

ings of the fuel injectior} systetn* ^ Occaqionalty he looks up 
for a cursory scrutiny of the students' faces, M coifple of 
students ^are a^lee^ in the back^ but mdst are'diligenily 



^scribbling down his "every word. Be wdniers whether he-B 
going too fast or too slow cr *3u^t ^ right. Be wonders whether 

• they understand the mysteries he^s laying forth/ Be wonders 
what'^ irt the minds behind those expressionless faces lx>6k'- 
ing back qt^ him. - \ • . 

If you're a former iqstructor, you * ve -probably had lot*^ 
of experience wifeh students in a classroom situation. If you 
haven't taught /'you' ve sti-11 had lots of experience as a stu- 
dent yourselfv Either wa/ you're well acquainted with vari- 
ous, classroom situatioris / iH^n working wLth ^be thing new 
and unTamiliar it's only natural to try to draw on whatever 
intuition or expyience you do have. There's the^rub. ^ There 
are substantial and important differencea between CAI and any 
othe^ educational medium. .Many CAI authors (both new and^* 
experienced!) feel most comfortable "translating" .their , 
understanding of the conditions of one medium Into another, 

-especially if they're pressured by time con^raints. That 
seems reasona|)le, but unfortunately most classroom t^echnique 
doesn't "^ranslate^ very well 'onto a computer. For example, 
we have^ encountered a nihnbar of former lecturer s who , after 
being enchanted l^y the poteftitial of the* computer, decided to 
convert much of their material to CAI. Unfortunately," their 
lessons turned ^ut to be transcriptions of their lec;tur€r5. 
That was what they knew best, so that's what they'did. ^ 

Let^s loojc ag-ain at the preceding 'scenarios and enumer- 
ate some of^he characteristics of the classroom and Iect\rre 
approaches. • ^ , 

The MDOst obvious* char-acteristic , of classroom^ instruction 

*is that it'5f group paced.' Instruction moves;^along at the - 
r-ate at which the majority of the' students canTceep pace. / 



This^naturallyjjieans that a fair" amount of the brighter stu- 
• dents' time is -wasted in ',sitting thr9ugh repetitions of i ♦ 
things they already understand. It also mean's that slower* 
students are often left beh^ml/'not onjly because they'don^t 
cat.ch, on to tfie material as quickly, but also because the^^re 
often inhibited about asking questions and , "revealing" theif 
, ig.norance. V They need specific, ind ividual" help btat jare often 
embarassed ^tfe askx for it. However, the instructor is* able to 
looK arbunci the rooin and visuajlly assess, student;?* reactions • 
to what's going on to catch any furrowed looks of perplex-^ 
ity, .or enthusiastic nods .of •recognition . • 

In "addl'tion, the instructor is often under- pre*ssure to 
cover a predetermined amount of material in a certain length 
of ti/HQ, and is thus compelled to pusir 'trie group harder than - 
may be^ wi%e. ^ - \ 

An advantage of classroom instruction is information 
from other students' mistakes. >faturally, wrong answers are-.^ 
wrong for a var'iety of reasons. One ^ddent may^give* a -wrong - 
response ano^er-would. never have- thought of, but the feed- 
back'on why s wrong can, be useful to bVth of them. " 

Finally, Xn *a classroom- situation , most of the necessary 
practice is done' outside the classroom where the instructor* 
has -no input control^ over .the direction the' student ^ s 
thinking is taking. . . ^ V 

An internhdiate^ Frendh class is rapidly filling class- 
room lOS-^-the '1^AI cla&sroom% ^Students enter j sit at separate 
consoles '(iermfytali) and begin working on individual lessonB. 
Each, student gpes .through the required 'lessons Ut his/her own 
speed: TjiuSj some students have nearly finished all the lea-- 
sojis^ while others a22e, farther behind. » - 

Carol Fishen is woi^kring 5n a lesson on verb conjugations. 



The material 8 ^in the Jovm of a^'ame^ ' and -Carol i sr. enjoying 

tiompetin-g against the computer. She has he^yi through this 

game re J but since .s'he 's aheq:din her wotk^ she'B de^aided 

to star.t. the day with a littte recreation— "play ing" ni 

conjugating verbs'. Though she^ s a fast learner^ and" confident 

.abow^.other grammaticfcl matters^ 'ahe feels she needs, the 

* . ^ • - * * * 

^ extra poidctice at verb conjugations . > ' 

Stephen Gardner is about halfway through the total num- 

*ber of lessons each student has to corfiplete , ♦ He 's *had trou-^ 

ble with translating and is working on a l^son on* reading 

aeinprehension^ He answers the first set.of questions azid the 

computer applauds^ "Good work^ Stephen! fhat wofi^a. tricky • 

passage qnd^you did'very well." However^. he has a little 

trouble with the ru^xt reading^^ and .the computer ctakejs him 

through a thorough analysis of the portions gf text thttt gav^e 

him the most problem. * ' * 

Laura .Blowers xs plodding along in a lesson on partici^ 

•pZes. Languages are^ not her forte and she'e doinff p^eitty 

poorly. ASyShe works through the lesion^ *she requires mot 

vnly a ^vd deal of on-line "reme^iatibfi, but also qonsider^ 

able assi^stance from the instructor who handles any\student . 

problems or questiojts that arise while they 're working on the 

terminals . Laura is aware that she gets much^more individual 

help in this , sett zng ihan' in a classroom situation^ and is 

glard of^it. * She^ figures she'd never pass thvsl^ourse without 

The most obvious char&cteris^tic of CAI Is that; it*S' 

self'-^paced . Students are freed from having Xo keep up with. 

" * . * * 

. on be .held back by other- students,. If . a student is havirtg 
'diff icul^^wi th some subject or concept^ his/her compre^hen- 
siop doesn^'t have .to , be sacrificed bb the group-'.s ""mdving 
ahead." * CAi is also individuali:5ed so tha^: each student^s' 



A particular problems can be deai-t *wi th. setparately either by 

* on-^lin^e' remediation or instructor assistance,-- Sirjce all>§t^K" 
dents',w6n*t reqlaire jthe same amount ok help, the instructor' . 
is, freed to speYid more feim^ with those who need the moSt . 
attention, ' ' , - ^ ^ '^-^ 

'using CAI, ea.ch studerif^has the chance to.arisWr (andv • 
: gel feedback on) ^each %iestibn- However, students*-can* t 
l^afn fronf each others' wrong j*esponses • ' Lessons can ^Isate. 
structured so that students ar^.^ble to "practicS" (ag^in 
with specific feedback), until'they f^el confident of whatever 
cc^ncept they're working on. -Of course, the. computer 'can only 
respond to actual student input. IX can't see the studeni, ' 
so it can't detect ^ose bewildered- looks instructdr^ ,'are so 
familiar wLthT ^ ' - T - " / - ' 

Sintje CAI is "different from other ins true ti<2>lal media/ 
you will need to make; some decisio-fis BEFORE you begin to 
^ write a lesson. Some of "these ma'tters were atopics you did " 
not even have to thinl* about in traditional instruction^*-^ 



^DECJDE WHY CAi IS THE BEST MEPIUM FOR^^FMS tE-SSOH. " - ^ 

. Y , '^ • ^ . • , ' 

CAI is not a treatment. It.i:$ a medium./* It has much to 
offer that is t>ot .available v^ia traditional Instructional 
■vehicles.^ If usecl^affpropr lately,', it ca^ be ,§x*treinely^ef fee^ 
tive« If used inappropriately, it may' h^y^ little to of£ 

After you**have chosen a'less.on to program, stop to ask yo.ur* 

\ . " -ft 

.self why you should use CAL* • You may want to generate a lot^ 
of. exercises for ' a drill. Perhaps you want , to cr-eat-e^a dia-' 
lo&ue situation irv which* the^student has verbal exchanges -"^ 
with* a simulated patient or/client,* "You may 'al^o want ,ib ^ 
ptavide the student with an experience which" is not 'feasible . 
'through ano^ther medium. Your students may vary widely>in f 
background and^ ability, so you may want t<J indij^dual ize 1 
instruction. For example, you may want to pfoi^de extra 
practice exercis'es, or -more de;ta41ed explanations only for • 
those student^ who need the help* . , 

How Would CAI Be A Disadvantage For -Ylou? ^ \ 

.-^ Perhaps it will^take too. long to produce a Ij.esson,'* Per- 
hs^s the ma^r'ial can ^ber taij^ght', just as readily by some other 
means, stich^as a teS:t"bool<^ or instructor, tit may be that the - 
^iudent will heed to use- a- reference page, and it*s too hard 
to go back and forth between displays'. ' 



MYTH:" A NEW AUSiOR- CAN. WBIT&, A "LESSON WITHOUT PLANNING. . 

'An author at a remote 8it& had 'just returned .iome after 
a one f week'. course in boding which aVpo -included xi ^mattering 
of insiructiohaV design. Be- felt .challenged by and Qnthuei- c 
astio aiout the po)!rential of CAI. Be was eager tVjbegin 
writing his own leeadns, B?. thought writing lessapa 'was . 
tremendcrusiy oredtive dnd ^e^, regarded himself as a creative 
person. . ^ / \ % ^ - ^ r 

during the short tmVning course^ staff instructor's had 
stressed ^the^ importance of preplanning as the first step '^n 
lesson writing J with ^particular emphasis given to»^a fairly, 
careful construction of a list of the things, ^the author act- 
vi^^fdrvoanted the 'student to be able to^ do^ dt 'the ^lesson's ^ 
^^nal, 'During the "training- course, the author had -seen the 
impor.tance jn'Tucfe prioi* analysis^ but once he^goi home and \ 
actually Hegan writings his fyrst lesson^he found prior ^tan- ^ 
ning rather tedious^^^a^ little like having, to practice scales 
when You want to pXay ^Beethoven. Be tried to 'decide ^hat 
material .should be included; he tried to plot out the les^^ ^ 
son's organization. Brit he felt stifled, anions- to really 
get dojj)n to ^writingV the lesson. Be finally announced 
that he (bein^ so highly creative) could not function this 
way. Bis Hechnique^ jwould he to eit at tie terminal , and 
"create'' in a rather ^.mproptu fashion^-ad^^Ubbing as he went 
along. -This procedure felt much^ore coufoi^table.* And df.tev 
all. he knew that other more^xpenienc.ed authors often , ^ 
"improvised* " Besides^ 'he^wds. bursting with' ideas -^he^Jiad 
seen' some fascinating games^>afid wanted'^o, ijir^te c^game; ne 
had seen some dazzlinaA€splays and warttedyS^ create some 
atavhids. So he out^^spirits highy' expectations even 
higher.-" Ee^^^g^led, hut fel^-^ini)igc>rated by the^ e.truggle.' 
He tahop-e^but felt cha%lefig.ed hy th-e labo.r. Be rhaipso- 
^^^df^ "Writing '^^aons'i'B so )^ea^ve and peraqnal—'it/B 



Uike giving bvvth!" 



SPightly over a year tater% he bore, a rxmhling^ hopr 

ecotohing^ patc}ip)ork erf a lesson^ disjointed.'and d^ibcordant^ 

a blend oj^ mayhem and mediocrity . ^Throughout the year most . 

of his. time hhd been eaten away* by rewprkiny^ reshuffling 

and rewriting what he^d a^ea^dy ^done. New material was 

tacked on to the end of, the lesson producing a i^atker^ "And-- 

oh^ye^I^forgot^to^mention...". effects He'd vorlstvuoied a 

^^game^j but i^hf.^ules were so complicated-no one could pldy 

it. Be had inclM4ed his ' graphics^ but they were Juvenile and 

cartoonish. The students for whom the lesson was writfen 

• • ^ ^ 

came to r^(^fer to it as "S^sake Street". - 



/^This aut^hor was well-intentioned, har^^-workirtg, and 
erfthusiastic, but he v^as ambuishect bj^» a number of designing 
"myths**. The first was that planai^g and writing a lesson - 
are somehow 'separate. That's like saying pl'aying the flut^ 
and learning what finger positions grod1jxjB--wiwt,.jigt;e^ 
two different 'things. Naturally creativity plays an llnpor- ' 
tan role in quality. h Just knowing finger positions is no 
gfiarantee that a perdon will be able to make quisle Cthough 
they may make noise! 1. However, not knowing ^^sitions is a 
virtual guarantee thjt th^y ^on' t make music. ^ 

Ro one, not everr^xperienced aathors, can simply sit / 
down, and writ^a lesson extemporaneously without some plan 
in- mfn0 (if riot on paper) for what they want' lo. do and what 
^they .want 'the student to do^. While it^s true that expert- 
enced authors of^en. ''compose** at the terminal, they are gble 
to (successfully, at least! )• only becauise they have a firm, 
broad springboard pf experiehce on which to rely. Any'craft 
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is grounded in a^ertain.js^ of skills' at WhicK* the Jtrafts- 
man must be ppx^iciri©>ot . '♦Th^y are the heart -^of the craft. 



i The au^^;>^^rO^ by Jt he outward behav- 

ior .of other more exper^^^ed auttiors*,/ He, only saw (and* 
believed) the fact that-tl^y W^f e- "able^ to "'ad lib"' a^ lesson/ 
on-line. didn*t se^e^ thre rf^n^al . of ganization^ thafhad 
golhe <^ or^' the f«ct 'that" the yN<pre able to "ad lib" only, 
because having written a number of ^lessons, they *h'ad prac- ■ 
ticed ancT become prc^'c-Jlent at^the necessary skills. * J&St as 
one would' no^^pect a jazz artist to improvise a piece of 
music without niving a sdl id.^muslcal filunxJation of discipline 
Bnd understanding, one cpuld not: reasonably expect that a 
"nov.ice" author could improvise a lesson without a solid 
instructional foundation of design . and "media experience- As 
a result of hX's e'k temporizing S^'ithQut sufficient .pl3nning, 
. the author' HPund up spendin'^g inqrdinate amount .of Hme ^ 

- redoing 'huge- cbunlrs^f his .aesson^ dragging lessbn develop- 
ment out mucj^ longer tha^i was warranty ^ 

Finally,' because he ha^-Ufeen impr'essed by demonstrations . 
of some interesting games* and graphics, he naturally, wanted ; 

- to incorporate^ simi Jar techniijues into his lesson . ' ^atherin/ 
new idea§ from' various source?^ is certainly a laudable 
approach, ..^^t he .tried to a^ply >techniqyes for their own* sake 
rathtf? than fp?"^eir educatior^l -effect. The net effect was 

.that they, were considere<?^ Juvenile "§nd inappropriate/ ^ 

Therefore, the best appro^h (especially if yo\i»re-not 
particularly experienced' witJ^^'C^l) . is to plan your lessons 
before you begin to. cotie theiJ-.' In order to do^ that you jccill 
'hav^ to»-make' a number of decis^ions.- 0/ie of the first, con- 
. cerns yiwr goals ' for the' student « 
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DECIQE 0}t TH£TGOAj.S'0F THE LESSOH. ' " • . V 

• Clearly and concisely stating what yon expect of the 
§tudent i^^one useful way of organizipg the lesson naterial'- 
both in your own mind and in the, «tudent*s nind*: 'This tech- 
nique can help you,/as the author, pare away irrelevancies ' 
•and stucture the, saterial in a less rambling', ©ore cohesive 
lesson. State expectations as vi^recisely and unambiguously as 
possible. Look at the .following exampl'es: t ^ * ' ^ 

Bad example: '"Know the names of the" parts t>f a truck 
engine," * ■ ' - ^ 

Good example: "Hatch the names of the, parts of a .truck 
-en^ne to the proper places, iri a -diagram, with 95* 
accuracy." , * * 

The terms in the firit example ar^e unclear and can be 
easily misunderstood/ What dbes the. author mean by "know"? 
^/he might mean "list" the pssrts of an engine, or s/he could 
inean that given a drawing o^;. an engine, the student will name 
each part. The second example, ^However , clearly conveys "7 
exactly what the student will liave Sometimes, goals 

can not be stated so, precisely; or^ri^exact behavioral terms* 
But wherever it's passibl^e, rather tlVan asking, "What do I ^ 
wajit 'the student t^know,^ ask ypuself, ^What* do I want the 
student to be' able- ta do?" * ^ • 

In addition to helping y6u ,organi2e the lesson material, 
stating specific expectations wiljL help ypu figure out how to 
measure whether the student has leacne'd wftat you had hope*-. 
Withoiit soE^ reliable measurement of ^the student'^ post- 
lesson .knowledge or skills,' you won»,t know whether you've ' 
efTectively gotten" the material across^ ' - - 
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•DECIDE .HOW YOU ARr GOIHG TO HEASOffE. STUDEKT. PERFORHAHCE. . 

'What Sorts Of Questions Should You Use? * * 

rrbe questions you choose depend on' the goals you^have 
set. For example, if your goal Is for*stu^ents to aeisorize 
the T^ultipl-lc&tion tables fron one. tp nine, you may wan-t to 
use sone sort of drill to measure th^ir perfornance. If your 
goai ts fo;- students to be afeie to appl? Boyle*s Law,, you'll, 
probably want to construct some ne^ pr9bless in which stjj- 
dents have to use Boyle^s Law. The* tric4< is to be sure your 
questions really do test* the^ skills yo6 intend. For example, 
suppose the student ^nsw^red the following question c^orrectly 

Type the nuEnber of the correct answer — 

. * ^ {) * 

Tne Pythagorean Th^r.^s states th^^he: 

^ 1. hypotenuse 2 = the S1P3 of the sides. 

2. Ism of the sides), d ythe hypotenuse # 

3. hypotenuse 2 = the sum of the squares of the sides. 

^. hypotenuse 2.= (sun of the iides) 2. ' ^ ^ 

. ' \ * ^ V - 

The^ost you can infer i.s that* the s^hJent is able to pick 
out the cowjfect answer wh^n given a choice. You cannot, how- 
ever, extrapolate that the studfet is also able to*siate,the 
tbeorep or apply it in a new situation/-. 



4t . 



Bow HSTjy Questions Sfiould You Use? 

At one CAI .site, end-of-iesson tests 'consisted of one 
test item per concept (tsuch' to tfte horror of assorted CAI 
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consultants!). Though there r^^^Hs no good ruje-of-thijmb 
for deciding on the nucfber of items, b^r in sind th€ diffi- 
cttl^ of the material ani. the typ^^--ef questions ypu*re 
using, ^Passing^dr failing one item jioesn't tell you a lot 
§bbut the studerit'*s proficiency. On the other hafl^, too ^any 



items can frustrate the Student. 



I o 
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• • * MYTH: ■ PRESEOTlNG ll^TEiCCHING (A LESSON IS CmiTEOT) 

. - ' - r 

4*. ^ uni.uers'ity CAI site^ the director decided thap aVl 
vi^oseot les^ne ahauld he evaluated by outa-hde^ opjitent 
exver%B_^ Hia deovaioyi was roundly- applauded by friend and 
foe alike' as a giant .step -toward' qiuility control. ,The revo- 
^utivnary ^ dij^cton constructed a list of guidelines for any 
: consultant reviewing the lessons^ ' The onty problem jwas that 
the only sorts of reviewer comments the director soUcitedior 
'allowed for were content questi^ons* In fact he went jso far 
as to specifically request that ''no comments be made about 
the workings or design of , the Idssoh itself. ^ 

This emphasia- 107} content dlone Resulted in the project 
lessons evolving over a period of time into "pag-e^ turners" — *^Ny^ 
heavily textual^ book-^like lessons with little student i^T^eV" 
action. Because of the density of the tixt, .students were 
strongly encouraged to sit cit their terminals an4 take notes. 



Host ^id — so thoroughly^ in fact^ that they began, to seem ^^ii^^ ' V 

like modern day scribes^ conscientiously trans<^ribing l\ittli' 

books of pheir own. ^ ^ , - ^ ' ^ " ^ 
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DECIDE WHAt approach THE LESSON WILL^TAKE.^ " '^'^ ■\ 

/ r ' - ' . • 

The^ beauty of a powerful CAI: system is that i% enables ' 

you to cho'ose from among many teaching- styles 1 ^You can use * 

* 

sophisticated stpdet^t/computer interaction to provide your 
studen'ts^ with experiences that are not otherwise possibl^^ Of 
course, the traditional text-laced-with-questions teclinique 
is als'^-e-^possibility , and maay new*authors begin there ♦ Tlie 
point is tbat many alternatives are^ available. You can use 
more jJ^^^n one in a lesson; you don't have to stay with p "slrt-r 
gle approocff thro,ughout. Here*, are a few -ex-amplajs^f what you 
can do. ' c 

■ ■ • ■ ■ ; • . , V 

drills — cycle students through a series of .problems ques-» 
,tians, definitions, ^tc. Questions can be given in the same 
order t9, all students or random^ selected from a pool of 
itemi. You .can also cycle students jb^ack through those items 
they^missed for extra practice. This is a good technique for 
reinforcing* rote memory skills such as foreign language 
vocab'ulary acquisition, Spelling , multiplication tables, spe- 
cialized tej'minology , etc. Acceptable student perfoftnance 
can bf set at any lev depejiding on youjr goals. They can 
range from a specified percentage to total mastery* ^ 

TutoriajLs — lead students through a socratic sort of <lia- 
logue. This is a good method for guiding students through ^, 
some process or problem-solving situation* As tfce author, 1 
.you can use tutorial^* to direct a »student^*s- thinking, - Sn. the 

c ♦ * * 

other hand,, students usually have'^ery^^ittle autonomy in^ 



this situation, and can sometimes f^ei, ntustrfeted . Authors 
somietimes opf^for using tutorials mainly |^'remMial or help- 
type situations (after .the student Iras either Vailed s-ome'' 
basic crftjerion-br ^Heque^Ve^d "help. • * ^"^^ ^. 



f 

Inquiries — basically present studit^tsTwith a "20^ Questions" 
situation in wJVich the computer presents an utilfflovm ,of some 

♦ ^rt (usually qhosen at random from a pool of ppssibiliti«es) , 
and students must ask question^Sf run tests o^ the unknown, 
.etc, to determine- what it is.' This method ha^ obvious* appl id- 
eations to the har.d sciences, but some im'aginatJive authors ^ 
can find applications for it in ojtlier discipline®* 

Si-^nulations — .place students' in a controlled, "r^al-life" 
situation in whicfi they must bring' the . situation to ?ome sort 
of resdlution. For example,, tbere are many clincial simula- 
tions in which students play the role of * the^ physician and 

.must take a patient history, do a physical ^exanfin^tion , 
request laboratory^ infownation^ then tie all the information 
into a diagnosi-s' of the i»atient*s (Condition. There are other 
simulations in which students play the role? of a mediator or 
other perspn in a position of authority who musft settle a 
labor dispute, negTotiate a peace agreement between warring 
factions, etc. There are as m^ny^ possibilities as 'there are 
f-eal-life conflicts. This method allows the 'studept to make 
mistakes which might be critical in real-life, but are*innoc- 
uous in the controlled en\^ironment of the simulation. It can 
also provide the student-^with a realistic situation or 
.dilemma s/he might otherwls-e have^ only befen able to learn 
about on a theoretical, level. This ^ is also an excellent - 
technique to use when your goal is to bring' about attitudinal 
changes. ( ' , « * 

J There are also o^lier^orts pfWsimulati-ons, however. You 
can put students in a simulated l.aboratory situation in which 
they perform some experiment or laboratory procedunef the 
advantages being that the reisults are b.ath •instantaneous and 
harmless! You can also put students in a predictive .simula- 
tion in.. which they "plug" data into a model, which theh,pre- 

• diets likely outcomes.' An example is a population dynamics 
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model in whlT:h the student feeds^in information on birthrate, 
available resources, etc., ajid the mbdel-'piots oUfc the conse- 
quences. , . " " , • 

Games ^ — put students in a situation in which they are in 
competition wj.th other students, the ^computer the clock, or 
anything ^else you can think of. Games may 'be realistic or 
faociful. Games are useful in developirfg numerous-skills, 
y^nd ^an turn learning into en-tertainment • 

. — - — ' * 

How Much Control Should St^i|,dents Have"?'' • * . * c 

Students- should h^ve the option of^^ing back to review 
lesspn material that they have already covered*, • The only 
potential problem i^ that students^ sometiftes spend so much ^ 

•#time reviewing, they don*t finish a lesson iri a reasonable - 
amount of time* . Your student data (or classroom observ^ion) 
will tell you. whether a ^student is spending too much tinj^e in' 
lessolis or .lagging behind'^in the curriculum. At that point . 
some direct interventi^on may ^e the best course. 

Going a step further, though, if the lesson material is- 

* flexible enough so that order is unimportant, consider- let- 
ting ^,fcudents determine, their own path through the lesson.' 
Chances are that . stude^ntg wh9 are unfajniliar with the subject 

.matter will tend to go through the material in order rather 
than jump- back' and- forth. However, students may ^ind dt 
helpful to" be able to skip anoDnd if jMiey are already famil- 
iar with t+ie^material^ or want io r^iew previous sections* - 
This can bQ handled a number of ways^ You can provide a les- 
:son index to which students hav^ access from anylpoint^in the 
lesson. They can then go\ through the material In sequence or 

•vary the order. If.'Vou want & little more conti^ol pver the 
course^^^udents take, you "fcan give thj^m> series ofMaore 
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limited choices, after each section sUch as: 

- ' Hp-V what would you like to do? 

(type, the letter of your choice) 

;* . * a, Ro to the neoct section 

b, >o back to a previous section 

c, go through this sec^tion* ag^in ' 

d, take the quiz on this section. 



Tracking the students* progress through the lesson 
-^ecomes even more important when' you allow them some auton- ' 
omy. Students -have been known to sl<ip parts that are^ unin-. 
terestln-R or too d'iff.icult-,- so you will want, to be- sure that 
;hey have been throjjgh^ every section before they complete the 
lesson. 

DECIDE HOW YOU WILL QUESTJON THE STUDENT. 

} 

CAI i5 similar to^a private tutor. It i;S J.nt6ractive 
and it allows every stu'dent.to answefx every question, A pri- 
vate tutor a^ks questions^ periodically^^to, find out if the 
student understands each section,, Th6 tbjbor, pr^xvides hints, 
explanq^tion , and other forms of remediatio'h^ as the need 
arises* In 'the same wa*y, the CAI lesson can ask qurestions to 
monitor the stude4it*s under standing .and- to provide additional 
help when the student needs it, A big diffe^rentee between CAI 
and tutoring Is that the tutor can inaJce 'de'pisiohs about vhat 
to ask and How\to resp-ond as he works- with^'' the student. The 
author of a CAI lesson- has to make many of th'ese decisions 
bejPore students try the lesson. . ^ 



What .Qjjestion Formats Should 'You Use? • 

Thei:;^e are manyrgood sources wifeH detall^ed .analyse^ of 



the pros and cons x)f each qiiestdon form over .the others (see- 
refer^ce Itst) . In t)ur present context, let- us. simply reit- 
erate the need \to ipatch the^type of inter action-'to the level 
of student competence you're aiming for/"' • 

Where Should You Insert Questions? ; 

Js^it good en 0T3gJ>Ay wait 'until Vhe end -of the lesson? 
Emphatic ally ^,,.^110! Thay nay seem- to bB,the simplest approach,' 
but in reality it Is inefficient^^ if the ^qu^Vtions at the end 
s1^^w th^t the stu<ient has failed, sZ-he may have to repeat the 
entire le|sb\ in srder to learn those p^t;^ that s>^he missed. 
In fact, if l^te^r material depends^ on understanding earlier 
content, ^ stiMent who dpes not learn the earlier part will 
be unable to get\any,thlng - out of later parts of ±he lesson 

Questidns s^iouid be ask^d both vithin the lesson'^nd at- 
the end. Where yo)| put them within the lesion depends on the 
Qature >Qf thg lfes;3tn, and the age and ability pf th^d. stu- 
dents^ If>yca;-^e presenting text;,, and there ts a lot bf 
re-ading ,/ there is an increased tendency for the student to' 
just re^d the words.' Ask questions after major ideas or coiv 
cept^^re Resented to be' sure the student is alert and 
learning as s/he go^s salong. If you are teaching rules," give 
the student some t>ractice to see i^ s/he can apply the rule. 

It^may. t^e' a good idea, to st-arl^ out by inserting ques- 
tions or practfee ,^y after major ideas. Aft^r-you try the' 
lesson with stu^cJents', ^you 'will find out where they need more 
help' and you can add ^ore practice in. thbse sections.. 

- • ^ - - ' " t ■ 

* • • • 

DECIDE HOW Td\ DISPLAY THE MATEillAL. 

Ho^w Much Should. ::ifou Put On A Single* Display? . ' 

Don't. give stv^ents toomuch to look at at one ti,ine.^ ^If 



the' display is, chock full of things, they msfy miss, the mo^t 
imi>ort^nt^ thin^, or th§y\jt^st may; give"up altogether. If yoa 
must present lots of Hex tj. do. it >in sm-all cblinks.' Present a 
few lines, "then ask the student to press^ a key to ge't -^"^few 
more line^ when s/he is ready,/- * 

How Should You Highlight Material? ^ ' - ' . 

The way In. which material is vi^^ually presented can help 
^r hinder the student. Sorting text^^visually can heip the 
student sort the material in his/her mind, and may make it^ 
ea^sier for himAher to** n^Wall it later on. ^or example, if 



you present a number of peftrjbs in^ a series^ numbering them 
and presenting them' ^ a vertical colum^n may/make it ^asie^ 
f^qr^he student to remember thati if you had iListed thenr in 
paragraph form. Underlining, capitalizing or writing in dif- 
ferent script can also highlight important words or Ideas. 

How Miich Time Should Students yave"To Read A Display? 

People read at different hates. .Ife is usually not wise 
to set* a ^gecifi^^^^ength of time for students to read or 
l(5bk at a Kfisplay." %et the students thems'^lves control the 
timing. ^For example , ^suppose yotr' want to pres^ent Some text 
and an illustrative animation. Students can*t read and ^atch 
the ah.imatlo»n" at the same time. Have%them press ^a key or 
ifidicate in sbme^way when t)iey ^re ready to look at the gra- 
phics. Sometimes tfie adthor wants -to retain part of a dis- * 
play, but also te^. change. T^art of it. Be sure to make It 



obvious^to the ^siStf^ents that , pgr t of the ^display has been 
chart^ged . * If yd'u rewrite a few lines of,^te)ct^,at the bottojn of 
the display, andv the* student is still lookinjg at^the top, 
s/he* will more than likely miss . the - fafet that 3 change took 
pl?tee.* ' ^ : ^ ' 
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-T^YTH: THE STUDENT WILL' RESPOND THE WA% YOU' ANTICIPATE. . 

■ ^ - •■ ^ ' '■ ^ . ■-. ' 

. *• . - , • • - • ,.. r ', 

f - . ■ ' •■ 

•^'^ '/It a CAT. site on a large college campus j a oVinicianrand^ 
a pvdgrainmer w^ve writing clinical^ajse simulqiion. Tfi^ 
case 1ia% one in a aeries_ of^ simulations for whiah the ^'shelJJ' 
hajdalredSy been programmed. The studenp^s goal was to diag^ 
nose and tr^eqt the^' ^patient 's^' condition. The model'was 
designed so that th^ student could gather a complete patient 
TvisiQvyj do a physical examination and requesp laborat 
wds an eaay matter to piug ca&e after case into^^^e 
programmed structure. The 'programmer had^veady run 
udents on a nianBev -^f other similar ca^^^i^ and had a Jair 
idea of^bat sorts of questions dr^^^^nses they were likely 

While going 'through ^aph section together^ the progz^amT 
mer suggested a numb ery<^" ptauaible student r'esponees that 
needed^to be ^allowea for . The clinicidn balked^ however, 
saying, ^^Why j^tnild they ask that? With the data they should 
alreadyjhdve, they should know, it d'oesn^^t apply, to, this 



'^Sometimed students are befuddled and don^t^ know what to 

ask next J so they ask a standard quest fon^ hpping it jj^li turn 

^ some clue.- Besides, at thi& pg.int injth^ "^eimulafiion. they 

may not have aslied ^ali , the. pertinent questions yet, and sb 

don*t' ^^al.ize' it-doesn^t a:pplyj ^ the- p^ograrmer* replied* \ 

I ^^But thejy should be told what a jstupid qu^siio'n thai? 

is/^ the clinician bellowed, becoming inQreasingty ^i}ritated " 

at^ these facjete^ss^ exasperating students* 

Tr/fyjj^g a simulation,* though; an attempt to reptiqate- ' 
^\ , • * - , 

real Xife as much €ls possible'. In real tife no one wilt- be 

tTyere io monit6'^ or ^nsor the, questions they i6?c a pUti^nt. 

Part of the paint here is for^ them to learn tTieiv own in ^ 

the safety of a sir^ulated situation what[s relevant and what, 

isn't.'' K r-^ , ' - / . \ , ' 



' "But with this 'a never ask that question!^ the 

ever Reddening c'^iniciqn retorted^ \j 

"TJiat^s because^ you^ve alxieady a jpfhysioian^ You oanH 
expect students to Have that same storehouse of krimoledge at 
this point. TTiey wouldn't have to^^ go to school ij thBy did^" 
the ^o^amm^r rejoine^d. • . ' -^^^ / ; - ' 

"They should 4>e^J>old ihey 'shouldn^t haihe asit$d\^ch a 
r dumb que$tion^ that xt^^ irrelevant, qnd that 'the^^T^'^y^out 
.OH, a limb. They should only ^ ask the questions we^ve already 
.arllowed for!" the blustering ctinicia/i bophted. \. 

• About a week later the .-clinician sto.od at^the^baok of a 
^c^fassroom smuggly surveying a group^ of s^:^ufent4'\going Hhrough 
his clinical cases. A number of students wejre stuolS^fid 
^tri^d vario^us respoxises, always with phe same ma-ddehing '^ 
resuit'"'"You s'houldn^t be, asking titdtf" With each slap pn'^\ 
the wrist, the students/ reactions escalated- from* puzzlement 
to frustration to out^and-^out anger.' The normally qxiteit r-^X 
classroom beggji^ to reverberate, the sound swelling, from Jialf^^ 
whzspered aursirijg to irritated muttering to a clamoring x'r oar 
of outraged students shouting to the t^pminals, to^hemselves 
andr^tg each other ^ ♦ _ ^ . * ^ n.^^.^ 

, '^"Row in the $%*?!? are you supposed to leatk'^any thing, 
ar^^^d here Idhen. /all you ^get is these $§f?^l snide '-^emarksi^:^- 
' ^"Who wasHhe H'^B!?% turkey who came up with tHia .lunacy^ 
anyway?!?" ^ ' -V ' * ■ . - 

"I^aht I h/ho ^does he. think he is ^anyway? I ^ "^^--".^ 
1 The clinician opted for a hasty, unheralded retreat, 

Students aren't mindread'ers. Neither are authors, 
ynless you become an or.thodt)3t devotee of thejnjjltiple-choice 

uestion", you.-' will sonretime' Have to" confrdfrtr.-the fact that ' * 
when you ask people to respond in an .open-end«d manner, they 



mray not respond- as you hoped or ar^t icipated (especially in' 
"conversational" settings like open-ended clinicar-^imtKla- 
f tions)'. Of course you will want to set a certain ' level of _ 
acceptability, but within ^that range^tudents -will probably 
come up with varied and sur^f ising responses'. -That * s just 
fine.: Part of the reason for putting material on-line at all 
is to individualize — to ^pa^er^to. ean^ studerit's needs as 
specifically as possible^. ^* 
» A big part of yaur^ problem will be to unravel and assess 

student '3 thiiiking as s/he\s going through^t.he lesson, 
^oth yoy and the student need to know how s/he*s doing, 
whether s/^ie' s gfasping the material. If s/be* S/H&ving trou- 
ble,* s/he neeWs lielp at that point, not after s/he's botched 
'some endrof-lesfeon test. This is especially crucial if the 
•-^lesson jraterial ^% in som% ftierarohy in which concepts build 
uDOjn each other. If the -student is lost at some link in the 
chain of concepts, your is l5o figure out where s/he fs ^' 
and help yim/her^get ^^artelf again.' X^e student* s'responses 
should^ b^ftaJi:en seriously.* In the previou:^ anecdote, the' 
>,-cl\nician would'^havT^done better to realize thaT if the stu- 
dent^we^e asking seemi^gTy ^ij|gelevarit' questions s/he was 
likely-^dunderiTig^^ound ^d -in need'* of ^help . 
^ y A big pert of, your probl&a wilX^be to unrav^ and assess 
the^student^s thiriklng as s/he*s-tgoingVWirough the lesson. 
^^i^,^you and «S>ha 'Stud erit need' to know how s/he*s doing, 
, whether s/he»s graspilrig the material. If^'s/he*s having trou- 
ble,* s/he needs help at that^ j>oMt ,* not after s/he*a botched 
some end-of-lee^on test\' This is especially crucial if the 
lesson material is in isome hierg^rchy in which concepts build 
upon feach^ther* If the student, is lost at some link in the 
chain of concepts, your job is to 'figure out vhere s/he is • 
and help hiro/her get started again. The student's .responses 

... c ■ . * ' ^ . - , ' 

sp^u-ld taken seriously^ In. the previous anecdote , ' the 



clinician wouljtl have donej better to Yealize that if the stu- 
dent were asking seemingly Irr'eley^nt questions s/he was 
likely floundering arobnd, an& in n%ed of helptj 



DECIDE • HOW TO ALLOH^ F0R\ ALL ^SJUDE NT ^RESPONSES, 

' Sfiiretime's , -students ga^y what you want them to, but in a 
different way/ but 'somet-imes they say something that you 
didn^t expects The following, quest ii)n 'is an example of the, 
former.. ' ' 



^ Fill in tire blani<* - / 



When teaching a concept,^ it is important to 
provi^^ Examples that-^draw. attention to its ^ 



attributes. 

4 



The^lesson author may expect "the student to answer wfth the 
same word that had been, use<:^ in thp text ("critical"), and 
program the lessoji to ta'ocept only that answer as correct. 

However, ,the student m6y respond ,i correctly , with such words 

f\ * ' - . c ^ * " , 

as "defining" or "rel^ant*^ 'The lesson developer must be 

' . , s- * 

prepared to accept all- reasonable alternatives as correct 

responses. However, rathen than trying ^;o 'anticipate all 

possible renditions, allow far a few obvious ones, then try 

the lesson out with, a few trial stu^^ts, adding resonaW< 

rejsponses as they come up»* 

The preceding scen^Vio illustrates t\ae second point. 

Evisn when the student's response is totally unexpected, it 

needs some feedback. The easiest solution is a catch-al-l 

phrase ofsome sort, td^lre^ct the student^back tO yyour line 

of thinking (while keeping a .record of ^.udent rg^Don-a^. and 

inserting , ^alternative. responses later on). 



Majce it simple for th^ student ^to'^^know what^ to do. For 
ex ani^i:$>' suppose the lesson, providers ^ numbei^ of. options such 
'as going'on to -the^ext /exercise , the" next section, the 
index or to a score, sheets Supp'ose , too , that the, student- 
must 'press, a different key for each alternative. Display the 
inf<jrmaMo<i where it^s easy to see, sd"' that it 'is available 
•when the**5.tudent needs it. Hay^e' y^u'can even provide it on 
a handout, or have it posted on the terminal* ¥he objective 
of the les'^on is to help the student learn some- particular 
content, not to see if s/he^can find his/her way around. 

Hak^^Et clear just whet form, of ^^€^ answer you expect 
the student* tQ give. Tor' example, consider the following 
problera'. 



Evaluate 1/2 

a) 12 ' b) 2 c) .5\ ji)U2 



You may expect s.tudents to answer with a letter, like "c", 
but it is not unreasonable f^r thera^ to simplx. type " ',5^, If 
you expect them to respond uiX,h th? -letter 'of .their choice,' 
tell them so. " ' * 

Provide .an adequate set of dir?^1^ions» Say it si«ply 
and in plai^a English. Try to V«ep the reading, level at, or 
below, the l^vel of course content. Be sure to include all 
of the information thai a student at the target leveh will ^ 
^eed to have* Remember, s/he does not have all of tjfie exper- 
iegce or knowledge . that, Vpu Jiave^*-and may need to fe^ told 
things that you take* for ^granted^ * * . 



DECIDE «0W TO BEPLY TO STUDENT SE^HSES. 



s 

Every serious student response heeds a meaningful- reply • 



o 



l** students ;5nswfr corrj&ctly, tell them so and do a little^ 
tpckvpattinp. Think o^ ways^to encowrafe students when they^ 
arf> cHoinf? well, but don't be indiscrirrin-ate . Gettip^the 
ri^^ht answer after two or "thre© tn^es is ok, but not spectac- ' 
ular^^So fnatch the degree of enthusiasm with tne particUlfl* 
'situation, * • . • 

Responding, to* k student's wrong, response is considerably 
^iffprent, '^Hien the student" is correct, your reply can sfm- , 
ply^center on the quality of his/h^r response, but i?hen the 
s^udpnt iswwrong, your reply needs J^o -center on |he content 
q,f his/Tier resttonse.. Whereas it*s perfectly all right to 
say^ **^es,,^ you're right," it's not usually enough to simply 
say, ."?'o, you* re ^ wrong Let's. lo^^at an exarsRl^' of some of 
the sorts, of feedback ypu can give if the student is wrong. 
Suppose you S?k the following question: ^ 



*^Fili in the .blank with the appropriate terro. 



Organic conpounds which ^aje*' used to build body 
t^ssjue are called- ^ * ^ 



/ 



^ou have at least four choices of ways to^espond if the stu- 
dent answers incorrectly. Fir«st, ^ou can siinply tell thie 
student*s/he is wrong. Since' this would give the student 
absolutely no clue as to ,w|jy s/he*s wrong, it*s not; the best 
alternatjjie'. ?^^ccond, yoiycould giVe a syfttactical hint such 

as, "pr^ "ffhis misht be^ helpful if the student were* 

working- an a.tr^sword puzzle, byt ^sn't very meaningful, in 
this sort , of situation. A third© 3lternatlve is to provide ^ 
general, all-purpose r^esponse for all wrong answers such -as, " 
'^These conpounds are composed of many amino acids*" This . ^ 
proV'id ys f nore elaboration and gives the student ^a substantial 

" / • ' ■ ^ ' C . if ■ . J ^ 



hint. If you want to be even r.ore attehtiye* howev<?r, you 
can look at tl^e student's/ answer and respond specificity to 
that, ^or examplje, if the stydetrt had ang^f^^Ked, ''caWohy- , 
drates", you night reply ^ **CarbohydratPS provide enerf^y-rather 
^than buiJd body 'tissue.'^ The compounds we're interested in 
are compo^^d of^nany amiqo acids." This tells the student 
why s/he!s wronr, and gives more information about^ the correct 
answer. . • ^ ^ , ' 

How ^uch detail you* 11 want to go into will depend t>oth 
on the ^jifficulty of the r^ateVial and on the questionnini^ 
technique yoy*re (isinp. P*or example, in a nathematics rfrlll- 
it' can be enough to sl^j^ply tell the student the right 
answer. If the student , made a cpmnon error (such as addinp 
rather than *nultiplying) , yo^ could point thait out. As 
interactions becdne 'nore complicated^ the student who ha^ 
i;^esponded lifcorrectly will . need a tuller explanation eitj^er 
of why his/+ier Answer is wrong or more elaf^o^at^ help^to * 

arrive at the correct answer. 

^» - / 

Ve've assumed here that the/student has responded before 

any feedback ^s^piven. 'Sometimes, without tliinkinp., authors 
Five the student the correct answer even before the student ^ 
gives an answer of' his/hep own. J=.eedback is most effectl^ve 
when the student first' gives* a serious {rather thiK nonsensi- 
cal), response . ' - / 

PCCIBr nov: to lei STUD^-filS KNOW HOW THFY»aE DOIHC. 

ItL the course, of nor'nal classroon interaction, students 
are able to* fet a sense of hot^ i^iell thej^'ra* doing con*pared to 
their classniates. However > workinp alone in CAI,^ they have 
no way of getting this, information. Students working irt CM 
have fowid it very lise^ful and desirable to have status data 
available on request^ Hli is can_ include a rlecord of the st^- 
dent^s perforin^nce, a record of how s/he st^ds^ ir;elafcive to 
the rest of the class/ or simply infornatj^on about wh^t^s/he 
has accomplished and what sr/he has left to do* 
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ffYTH: LESSEN DEVELOPrdENff IS- A OJffi-SHOT EFFORT. 



At one fledgling CAT aite^x the staff (entirely Cjpmposed 
of novice abhors) disregarded consultants' warnings *thqj^' ^ 
lesson development was an iterartive rdthe;rs titan a one^time^ 
around^procBsB * Though the c^nBultant^ stress ed-^the imppv^ 
tance of numerous tria't runs before actual* student runs the 

'-^authors felt that o^^^^^ving a couple colleagues go thjfwcgh 
their lessons* they could eliminate virtually all programming 
or design errors. Since the authors^ were- not yet familiar 

^enough with'4j^e medium to recoqnize potential pitfalls, their 
comments (usually rendered on the basis of only one trip 
through the lesson) almost invai^iaply ' focused on incon^equen-^ 
tial' bugs s^uprh as spBlting or punctuation errors* Authors, 

'however, interpreted this dearth of useful criticism as an 
indication that their lessqns were largely ^fr^e of ftaws a\d 
that these cursory critiques were indeed ^11 that was ^really 
necessary , Thus armed'with their comrades 'blessings ^phe 
duthors sallied forth, confidently unlg^shing their ^^eseons 
on tHe unsuspecting students • ' ^ ' 

Within days at least one studen,t was labeled^an^^atti^ 
problem" and threatened bith disciplinary action (he had 
complained because, afier over an hour in a tesson, a pro^ 
grammina error near the end kicked him out and gwm^ed him 
back to the very beginning, requiring ^that ae "ikrougTi phe 
entire lesson *again) . Authors found themselves frcffitiaatty 

^fixing errors as fast qa they were reported bo that students 
could either get out of oz; g^et into ueCrious portions of lee^ 
sons. Studerits were maddening^lry-^gvymied by questions' which 
left them s£ubk in a lea^l^ with no idea what €o vespjond, no 
clues or help^ and^ no way -to either move backward or forward » 
within tjie lesson. Within 5 mi^nths ther^ was>a virtuatly , 

'un^imdus student mutiny, with nearly all asking to be Teas- ' 
fidgned t^ a non-CAZ class* , * . - v'^' . * 
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Nearly all creative work, involves an iterati-ve process. 

Vriters 'Write first, second and 'even th^rd drafts before 

their books are\ published . Architects draw sketch after - - 
* \ ' ' * 

sketch before .Wttlinr on a design for a building. Any ti^e 

» • ff- ^ " 

there »are choices to be made or ^lor^- than one way to go about 

scrjethinr, , the fd^ial product is a resul^t of successive 
approximations, doing an^ redoing, trying out and scrapping, 
until -the- end result "works". A pri'me requisite in this* pro- 
^ss is feedback fr*on various sources. 4 writer can send a 
kodV to his/'^er edCitor,'^r an architect can show iHs/her 
sketches to cfollea^ues. * A CAT author, though, has a peculiar 
problem. ^ hook or\ sketch can be criticized in its entirrty, 
the critiouer/ havinA seen all the finished product. A lesson 
however, can 'be so individualized^ that successi-ve'^person 
^oing through it s^sy Isee a slightly differ^t lesson than the 
previous person. FacA person wil'L, the'refore, have seen some 
(not all) of tile- lesson. People may answer questions differ- 
ently ,and thus get diffTe'rent feedback for' their responses^ 
Tone people need help att certain junctures while others do 
not. If the student is. allowed to control his/her own path 
through the lesson, eacf] fpay take a slightly different direc- 
tion. And all thase variables 'are fraught wfth ambushes. 
Feedback to stiwent" re^onses may be inadequatie or unclear^ 
remediation may be^ incom/plete. of superfluous T -certain ^ 
sequencing may seem jumbled or disorganized. A handful of-, 
colleagues going through a lesson canH possibly pln^' dcJwn all 
the potential pitTalls. Jhe 'best solution is to try the les- 
son out pn lots of ^students IJefore you give it to the'stu-/ 
dents it was *wr listen for — not 'because you want -lots of "dif- 
ferent opinions"', but because the more people whd^ go throut^^h 
it', the more errors and oversights will* be uncovered. 

* 
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OFCTDE ?'0V TO EVALUATE YOU'? LESSOM. 



Sometirncs an idea seems really g^pbd , hut when you put it 
on a computer it doesn't sepm to fulfill its promise. If you 
• try out parts of the lesson rather than trying to do the 
/ whole"^ thinf? q% once, you can pre/ent having to overhaul or 



scrimp larpe portions of work because some fundameTital defi- , 

cieVciesih tbp lesson were not discovered ^until after the 

lesson was, "finished." In the long run, the mo^ efficient 

^ay to writ« a lesson is to plan right frots^ the beginning to 

evaluate the lesson and revise it as you j^o along. This is 

_ ' c ' 

called ^fornative*^i*valuation" — evaluation* for the purpose 

of inprovinR or polishing the lesson as it ^s being "written. 

^rather than *as a whole after it's completely. coded) . 

There are. a number o'f questions you-<shpu*ld be seeking to 

answer in evaluating' your lesson. For instance, • 

— i^r the coiftent accurate? - / 

— are there profjranrrinp errors? ^ ^ ^ 
' , — are^ there places where students can get 
g stuck with no available help? \, 

— ai;,e^here questions where stud^t5 answer 
^ correctly ^t)ut are, Judged as -fncorrect? 

There are at least three^major sources for answering 
these questions: peer reviews, student trials, and on-line 
data' collection. Rach serves a different pyrpos^e and should 
really not'be used as a substitute for any ^f the tTthers-. 

Peer reviews . Colleagues cart help you by checking on -^content 
accuracy. They can also ?ive suggestions oh alternate 9r 
better methods of presentation, _ 

, Ftud ent trials. One objective of student trials is "to find 





f 

out whether the student can Ret through Jthe les^^ without ' 
your standinp, over his/her head ^nd telling paying, "Tnat*s 
not what I meant. Mere's the^way you* re supposed- to do that.*i 

i 

rather objectives are to locate particular problem spots* or ^ 
,proeramifing errors, and to ijdentify addlMonal -prerequisite 
sJ^ills that may be necessary in orrfer. for the student to sue- 
jce^sfully complete the lesson/ # . * - 

jA'hile^ 4t*s difficult to state a specific rule for how' 
man^ students should go through yo.ur lesson, one -clue is the 
nunber' of' errors or- possible revisions you find with each 
student trial. As long as you continue to uncover important 
flaws, you should continue to revise and>student-test the ^ 
lesson agaii4 and a^'.ain. Using just a few students at a time w 
makes revision less awesome. 



, , Always retest a lesson afjter you've made revisions. 
Sometimes revisions don't solve the problem, or in trying to 
fix one errbr'an author inadvertantly . creates another error. 

Pata ^ collection . The computer ^can collect information for i ^ 
you on such matters as les^son completion times, incorrect 
responses, error rates, and general performance. These can 
serve "a^ a basis* for . intelligent decisions about th€^ kinds of ^ 
revisions that need to be made. ' ^ , 

Somje measures of lesson quality that can be detected * ' 
throuf'^h on-line- data ^re: percentage of students who psTss an * ' 
end-of-lesso'n test after going tlirough the lesson once,, per- 
cejitage of students who do not - complete the lesson, and the ^ ^ 

number of times students ♦repeat the 1 essoin ♦ . . 

* • • • 

J^ow To You Know The Lesson Is^eady^For General Use? 

Vhen . there are no programming errors.. 34;udents' can com- ^ 
plete the material within an allotted time^ and students are - * 
able to get through the* lesson without comin^^ to a dWd end, 

■ ■ ■ . ■ - - ■ ■ 
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yQU can bPF4n^to thinly about. uslnR the lesson with "real*^ 

c 

stud en ts, ^ " * 




SUMMARY CHEtJKLlST; 



Planning 



Are performance go,als il^early-^-sta^ted?- 

— Is there an end-of-^lesscfn test? ~ . ' — 

- Are question's appropriate to desTre'd ^performance level? 
7 Are threre; too few or too many questions? ' - ^ 

— 'Do^you have a lesson eval-uation plan?'* " * " 

Cdntentf " ' / ' 

' — What instructional approach(e?) are you using? 
( ^ 'Drill? r ^ 
' - Tutorial? • ^ 

Inquiry?^ 

•'^ Simulation? - " 
• - Game? I ' ' ^ 

Ftow much autonomy dpes the studeni have? 
. — Are tfiere questions throughout the lesson? 
Is transition smooth between ideas? 

Displ^ing Material > * * 



t Is there to©* much material oft the screen? ^ \ 

— Are important words *or ideas higjilighted? 

— Does tM screen" everXwritie at two places at once? 
•^"-^ Is the student allowea to read at his/her own pace? 

jSttudent Responses 
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— Are diKectcions ^leai 
Have you allowed for<3 vari^ety of responses? 
Does feedback give addfed help or information? 

— Do you let students know how they're doing? * 7 

- 39; 
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Evaiuating^ Your Lesson • ' ! - 



*- Are ther^ content errors? - ' ^'^ w / 

— Are ^there programming errors?. - " 
• — Can students get -stuck with no available help7 

— 'Are students* answers ^ever judge.d as wrong whelft they're " 
-^correct? ^' > . » ^ %* y ' 

— Have colleagues been 'through yotir lessort? ^ . ^ 

— Has the lesson been pretested ^by 'l^rial r)sns7 — 

— Ar'e you collecting student performance data?^ 

— Do "you review student data frequently? ' * 
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